On Existence of Limiting Distribution for Time-Nonhomogeneous Countable Markov Process

نویسندگان

  • Vyacheslav Abramov
  • Robert Sh. Liptser
چکیده

In this paper, sufficient conditions are given for the existence of limiting distribution of a nonhomogeneous countable Markov chain with time-dependent transition intensity matrix. The method of proof exploits the fact that if the distribution of random process Q = (Qt )t 0 is absolutely continuous with respect to the distribution of ergodic random process Q◦ = (Q◦t )t 0, then Qt law −→ t→∞ where π is the invariant measure of Q◦. We apply this result for asymptotic analysis, as t → ∞, of a nonhomogeneous countable Markov chain which shares limiting distribution with an ergodic birth-anddeath process.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov‎ ‎processes

‎In the present paper we investigate the $L_1$-weak ergodicity of‎ ‎nonhomogeneous continuous-time Markov processes with general state‎ ‎spaces‎. ‎We provide a necessary and sufficient condition for such‎ ‎processes to satisfy the $L_1$-weak ergodicity‎. ‎Moreover‎, ‎we apply‎ ‎the obtained results to establish $L_1$-weak ergodicity of quadratic‎ ‎stochastic processes‎.

متن کامل

Existence and Regularity of a Nonhomogeneous Transition Matrix under Measurability Conditions

This paper is about the existence and regularity of the transition probability matrix of a nonhomogeneous continuous-time Markov process with a countable state space. A standard approach to prove the existence of such a transition matrix is to begin with a continuous (in t) and conservative matrix Q(t) = [qij(t)] of nonhomogeneous transition rates qij(t), and use it to construct the transition ...

متن کامل

The Rate of Rényi Entropy for Irreducible Markov Chains

In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.

متن کامل

Poisson Representations of Branching Markov and Measure-valued Branching Processes By

Representations of branching Markov processes and their measurevalued limits in terms of countable systems of particles are constructed for models with spatially varying birth and death rates. Each particle has a location and a “level,” but unlike earlier constructions, the levels change with time. In fact, death of a particle occurs only when the level of the particle crosses a specified level...

متن کامل

On the Poisson Equation for Markov Chains : Existence of Solutions and Parameter Dependenceby Probabilistic

This paper considers the Poisson equation associated with time-homogeneous Markov chains on a countable state space. The discussion emphasizes probabilistic arguments and focuses on three separate issues, namely (i) the existence and uniqueness of solutions to the Poisson equation, (ii) growth estimates and bounds on these solutions and (iii) their parametric dependence. Answers to these questi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Queueing Syst.

دوره 46  شماره 

صفحات  -

تاریخ انتشار 2004